Self-Organized Criticality, Optimization and Biodiversity 
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By driven to extinction species less or poorly adapted, the Darwinian evolutionary theory is intrin- 
sically an optimization theory. We investigate two optimization algorithms with such evolutionary 
characteristics: the Bak-Sneppen and the Extremal Optimization. By comparing their mean fitness 
in the steady state regime, we conclude that the Bak-Sneppen dynamics is more efficient than the 
Extremal Optimization if the parameter r is in the interval [0,0.86]. The determination of the 
spatial correlation and the probability distribution of the avalanches show that the Extremal Opti- 
mization dynamics does not lead the system into a critical self-organized state. Trough a discrete 
form of the Bak-Sneppen model we argument that biodiversity is an essential requisite to preserve 
the self-organized criticality. 
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I. INTRODUCTION 

By all that we know nature evolves in a self-organized 
critical state p). One of the most fundamental char- 
acteristics of a system in a self-organized critical state 
(SOC) is to exhibit a stationary state with a long-range 
power law decay of both spatial and temporal correla- 
tions [31 ■ Power law is a very abundant behavior appear- 
ing either in natural phenomena such as the light emitted 
from quasars, the earthquakes intensities, the water level 
of the Nile river or as a direct result of human activities 
like the distribution of cities by size, the repetition of 
words in the Bible and in traffic jams. 

Self-organized critical systems evolve to the complex 
critical state without the interference of any external 
agent - there is no tuning parameter. The prototypical 
example of SOC is a pile of sand Q- Usually, the self- 
organized state is attained only after a very long period 
of transient. Last but not least, a minor change in the 
system can cause colossal instabilities called avalanches. 
Intermittent bursts of activity separating long periods of 
quiescence is called punctuated equilibrium. Gould and 
Eldredge conjectured that the biological evolution in our 
planet is under the auspices of this kind of mechanism 

I 

The evolution of the living beings is basically governed 
by the theory of natural selection. One model specially 
tailored to represent the co-evolutionary activities of the 
species is the Bak-Sneppen model (BS). In this model 
[4J, each species occupies a site i of a lattice and has as- 
sociated a fitness value Xi between and 1 ( randomly 
drawn from an uniform distribution). At each time step, 
the species with the smallest fitness as well as its nearest 
neighbors are selected to replace their fitness with new 
random numbers. In one dimension, after a long tran- 
sient time, almost all species have fitness larger than the 
critical value 0.67 0. 
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Recently, inspired by natural processes, some heuris- 
tic optimization techniques have been proposed: genet- 
ics algorithms l5( , simulated annealing and extremal 
optimization [7|. The latter, the extremal optimization 
method (EO), is the most efficient since it brings the sys- 
tem faster and closer to its ground state. In brief words, 
this method consists of the following rules: 1) a fitness Aj 
with values between and 1 (randomly chosen from an 
uniform distribution) is associated with each site i of a 
lattice with N points; 2) all the lattice sites are increas- 
ingly ranked according to their fitness (the site with the 
worst fitness is of rank 1); 3) a site of rank k (1 < k < N) 
is selected with probability P(k) ~ k~ T (r is an arbitrary 
real positive number) and its corresponding variable A^ 
is changed to A i ; 4) repeat at step 2) as long as desired. 

We observe that, differently from what happens with 
the Bak-Sneppen dynamics, the EO dynamics has neither 
a co-evolutionary feature (the extinction of one species 
has no influence on its neighbors) nor has the exact 
(Darwinian) characteristic of the elimination of the worst 
adapted species. In this sense, we can say that the BS 
algorithm is a coarse grained description of the biological 
evolution adopted by nature while the EO algorithm rep- 
resents an optimized dynamics created by man. In this 
paper, we compare the efficiencies (measured by their 
mean fitness in the steady state) of the EO and the BS 
dynamics. For the EO dynamics, we show that the spa- 
tial distribution is constant meanwhile the distribution 
of avalanches has an exponential decay. Using a discrete 
form of the BS model we argue that variability of species 
is an essential requisite to keep self-organized criticality. 



II. SIMULATIONS 

To compare both dynamics, we simulated the BS and 
EO algorithms up to 1.1 10 9 runs on a one dimensional 
ring with N=400T sites. To guarantee that the stationary 
regime has been achieved, we discarded the first 1.0 10 8 
runs as the transient time. Time averages were then 
taken over the remaining steps. Figure 1 shows the aver- 
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age frequency of the fitness A. Clearly, for r = 0.05 the 
EO behaves like a random walk having an almost uniform 
and constant fitness distribution. At r = 0.5 (1.0) the 
distribution is an increasing linear (exponential) function 
of A. For the BS dynamics, however, the distribution has 
the form of a step function with a discontinuity at the 
critical point A c ~ 0.67. This critical point exists in all 
regular geometries or exponential networks |8ll9l.ll0|. but 
not in scale- free networks ^lj • The presence of this crit- 
ical point in the BS algorithm is the first sign that a 
critical self-organized state has been developed. For the 
EO there is no such a point. 
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FIG. 1: The frequency of the fitness A averaged on time after 
the stationary regime has been reached. The full line cor- 
responds to the BS algorithm and exhibits a discontinuity at 
the critical point A c ~ 0.67. The dotted lines are the EO algo- 
rithm with t — 0.05, 0.50 and 1.00. The points represent the 
discrete BSD algorithm with only 10 possible discrete fitness 
values (see the text). 

To measure the algorithm's efficiencies, we plotted 
in Fig. 2 the mean fitness obtained in the steady state 
regime. For the BS dynamics the mean fitness is 0.83. 
This mean fitness corresponds to an EO with r = 0.86. 
At r = 1.5 the mean fitness of the EO dynamics is ap- 
proximately 0.99. This means that for higher values of r, 
the EO algorithm leads to an Utopian society where only 
one and perfect species survives. This limit corresponds 
to the simplified toy model proposed by K. K. Yee 0] 
in the context of law's evolution in the judicial system. 
For r in the interval [0,0.86], the BS surpasses EO. 

As we pointed out before, while BS is a co-evolutionary 
dynamics the EO dynamics is only evolutionary. The 
species in the EO do not interact. Comparison between 
co-evolutionary and evolutionary performances have al- 
ready been done in the context of cellular automata |l8j | . 
To investigate the main differences between the evolu- 
tionary (EO) and co-evolutionary (BS) dynamics, we 
studied their spatial correlation dependence. Let D(x) 
be the probability distribution of the distance x between 
two subsequent extinct (or mutated) species. From the 
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FIG. 2: The mean fitness of the EO dynamics for various 
values of r. The BS (BSD) algorithm has a mean fitness 
value of 0.83 (0.86) which corresponds to r = 0.86 (0.95) in 
the EO curve. 



Fig. 3, it is clear that the EO dynamics does not show a 
critical self-organized behavior. Instead of a power law, 
its spacial correlation is of infinite range - the probability 
distribution is constant no matter what is the distance 
between two subsequently modified species. For the BS 
dynamics, we find the well known power law dependence 
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FIG. 3: The EO algorithm has a constant distribution prob- 
ability D(x) which is independent of the r value. The BS al- 
gorithm shows a power law decay while the BSD has a mixed 
behavior. 

Another important difference between the two dynam- 
ics is the complete absence of the punctuated equilibrium 
in the EO algorithm. One way to check out the existence 
of the punctuated equilibrium is to measure the proba- 
bility distribution P(A) of the avalanches with size A. 
The size A of an avalanche is defined as been the number 
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of subsequent time steps with at least one fitness value 
below a critical threshold A c . This critical point doesn't 
exist for the EO (Fig. 1). For the BS algorithm the dis- 
tribution decays as P(A) ~ ^-i-07±o.oi at Ac = 67 
In the EO algorithm, on the other hand, the decay is ex- 
ponential with a characteristic avalanche size A c (\ Ci t) 
depending on the choices made for A c and r. 

III. CONCLUSIONS 

We conclude that although the efficiency of the EO 
algorithm may exceed, under certain circumstances (if 
r > 0.86), that of the BS dynamics, it is accompanied by 
three undesirable characteristics: the spatial correlation 
between the species is constant, i. e., it is independent 
of their distances, there is an external free parameter r 
to be adjusted by hand and the punctuated equilibrium 
mechanism is lost. The punctuated equilibrium seems to 
be a very productive form found by nature to innovate 
species without the intervening of climatic changes or 
meteors destruction. 

We have learned that the EO dynamics does not con- 
duct the system to a critical self-organized state. How- 
ever, we would like to point out that even the BS can 
loose its SOC characteristics and, amazingly, in a very 
easy and quick manner. Suppose that, instead a continu- 
ous and uniform fitness distribution in the interval [0, 1], 
only some discrete values are now possible. To simplify, 
assume that the fitness can only have Q equally spaced 
values, i. e., A = m/Q, with m = 1,2, ...,Q. Practically 
this means, that for some reason, the system's biodiver- 
sity has decreased. Due to the discreteness, there will be 



an enormous number of species carrying the same (worst) 
fitness value. Which species should then we choose? The 
simplest solution is to put all those species in a list and 
to draw one of them. We will call this dynamics as Bak- 
Sneppen with draw (BSD). In the Fig.l we plotted the 
case Q = 10 and observe that, like in the EO dynamics, 
there is not a critical threshold A c . The mean fitness is 
0.86 (Fig. 2), a value which is a little bit greater than that 
of the standard BS. The curve of the spatial probability 
distribution D(x) (see Fig. 3) is even more interesting. It 
shows that the BSD dynamics is of a mixed kind: it be- 
haves like the BS for small distances and like the EO for 
large distances. So, the BSD dynamics does not retain 
the self-organized criticality characteristic. Just like in 
nature, biodiversity plays a fundamental role in the evo- 
lutionary theoretical models: without it self-organized 
criticality is not possible. For higher plants and animals 
the conventional explanations of biodiversity are habi- 
tat heterogeneity, predation pressure and niche differen- 
tiation. For microscopic organisms, however, the high 
biodiversity found (even in uniform environments) is not 
completely understood and it is called "the paradox of 
the plankton" . Theoretically, such difficulties can be 
surmounted by incorporating a noise r\ into the fitness 
A = m/Q + ( 1 — 2r)rj (where r is a random number in the 
interval [0, 1] and generated from a uniform distribution). 
Even for 77 as small as 10~ 12 the SOC characteristic is pre- 
served 15]. The noise can be interpreted as the presence 
of sub-species. 
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